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Abstract 

In this paper, we consider a muhi-agent consensus problem with an active leader and variable interconnection topology. The 
state of the considered leader not only keeps changing but also may not be measured. To track such a leader, a neighbor-based 
local controller together with a neighbor-based state-estimation rule is given for each autonomous agent. Then we prove that, 
with the proposed control scheme, each agent can follow the leader if the (acceleration) input of the active leader is known, 
and the tracking error is estimated if the input of the leader is unknown. 

Key words: Multi-agent systems, consensus, state estimation, active leader. 
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1 Introduction 

In recent years, there has been an increasing research 
interest in the control design of multi-agent systems. 
Many results have been obtained with local rules ap- 
plied to each agent in a considered multi-agent system. 
These neighbor rules for each agent are based on the av- 
erage of its own information and that of its neighbors 
or its leader (Fax & Murray, 2004; Jadbabaie, Lin, & 
Morse, 2003; Lin, Broucke, & Francis, 2004; Olfati-Saber 
& Murray, 2004; Savkin, 2004). For example, Jadbabaie 
et al. (2003) demonstrated that a simple neighbor rule 
makes all agents eventually move in the same direction 
despite the absence of centralized coordination and each 
agent's set of neighbors changing with time as the system 
evolves under a joint connection condition. Also, with a 
similar technique, Lin et al. (2004) studied three forma- 
tion strategies for groups of mobile autonomous agents. 
The stability analysis of multi-vehicle formations was 
given with a Nyquist-type criterion in (Fax & Murray, 
2004). Moreover, by a Lyapunov-based approach, Olfati- 
Saber et al. (2004) solved the average-consensus problem 
with directed interconnection graphs or time-delays. 

In reality, some variables of the agents and/or the leader 



Email addresses: yghong@iss.ac.cn (Yiguang Hong) 
jphuOamss .ac.cn (Jiangping Hu), lxgao@amss .ac.cn 
(Linxin Gao). 



in a multi-agent system may not be able to be measured. 
Fax et al. (2004) raised this important issue regarding 
observer design for multi-agent systems, and first tack- 
led this problem. However, many works remain to be 
done for the distributed observer design of networks of 
multiple agents. 

With this background, we consider a consensus problem 
with an active leader with an underlying dynamics. Here, 
some variables (that is, the velocity and maybe the ac- 
celeration) of an active leader cannot be measured, and 
each agent only gets the measured information (that is, 
the position) of the leader once there is a connection be- 
tween them. In this paper, we propose an "observer" by 
inserting an integrator into the loop for each agent to 
estimate the leader's velocity. To analyze the problem, 
a Lyapunov-based approach is developed. With the pro- 
posed estimation rule and a selected Lyapunov function, 
the leader-following problem can be solved if the leader's 
input is known, while the tracking error can also be an- 
alyzed if the input is unknown. 



2 Problem Formulation 

To solve coordination problems, graph theory is helpful. 
An undirected graph Q on vertex set V ~ {1, 2, • • • ,n} 
contains V and a set of unordered pairs £ = {(i, j) : 
i,j e V}, which are called G's edges. If there is an edge 
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between two vertices, the two vertices are called adja- 
cent. A graph is simple if it has no self-loops or repeated 
edges. If there is a path between any two vertices of a 
graph Q, then Q is connected, otherwise disconnected. A 
subgraph A" of ^ is an induced subgraph if two vertices 
of V{X) are adjacent in X if and only if they are adja- 
cent in g. An induced subgraph X oiQ that is maximal, 
subject to being connected, is called a component of Q. 

Here wc consider a system consisting of n agents and 
a leader. In the sequel, the state of agent i is denoted 
by Xi for i = l,...,n. With regarding the n agents as 
the vertices in V, the relationships between n agents can 
be conveniently described by a simple and undirected 
graph which is defined so that defines one of 

the graph's edges in case agents i and j are neighbors. 
Ni{t) denotes the set of labels of those agents which are 
neighbors of agent i (i = 1, n) at time t. The weighted 
adjacency matrix of Q is denoted hy A= [a^] G i?"^ 



where a,- 



and cu 



> {aij > if there is 



an edge between agent i and agent j). Its degree matrix 
D = diag{di, ...,dn} G i?"^" is a diagonal matrix, where 
diagonal elements di = Yl^=i ^ij * = 1, Then 
the Laplacian of the weighted graph is defined as 



D-A, 



(1) 



which is symmetric. In what follows, we mainly concern a 
graph g associated with the system consisting of n agents 
and one leader. In fact, Q contains n agents (related to 
graph Q) and the leader with directed edges from some 
agents to the leader. By "the graph, Q, of this system 
is connected" , we mean that at least one agent in each 
component of Q is connected to the leader. 



For the multi-agent system under consideration, the re- 
lationships between neighbors (and the interconnection 
topology) change over time. Suppose that there is an in- 
finite sequence of bounded, non-overlapping, contiguous 
time-intervals [ti, ti+i), i = 0, 1, • • • , starting at to = 0. 



Denote S = {Gi, G2, ■ ■ ■ , Qn} as a set of the graphs with 
all possible topologies, which includes all possible inter- 
connection graphs (involving n agents and a leader), and 
denote V = {1,2, - ■ ■ , N} as its index set. 

To describe the variable interconnection topology, we 
define a switching signal a : [0,oo) V, which is 
piecewise-constant. Therefore, Ni and the connection 
weight ttij {i = l,...,n,j = l,...,n) are time- varying, 
and moreover, Laplacian Lp (p € V) associated with 
the switching interconnection graph is also time- varying 
(switched at t^, i = 0, 1,---), though it is a time- 
invariant matrix in any interval [ti,ti+i). In our prob- 
lem, we assume that there are fixed positive constants 



aij {i = 1, ...,n;j = 1, n) such that 

{aij = aji , if agents i and j 
are connected at t (2) 
0, otherwise 

Meanwhile, the connection weight between agent i and 
the leader, denoted by bi, is time-varying, too. We as- 
sume that there are fixed positive constants Pi {i = 
1, ...,n) such that 



bi{t) 



(3i if agent i is connected to the leader at t 
otherwise 

(3) 



The next lemma was given in Horn and Johnson (1985), 
to check the positive definiteness of a matrix. 

Lemma 1 Suppose that a symmetric matrix is parti- 
tioned as 

El E2 \ 



E 



^Ej E^j 



where Ei and E3 are square. E is positive definite if and 
only if both Ei and E^ — E2 E^"^ E2 are positive definite. 

The following result is well-known in algebraic graph 
theory (Godsil & Royle, 2001) and establishes a direct 
relationship between the graph connectivity and its La- 
palcian. 

Lemma 2 Let Q be a graph on n vertices with Lapla- 
cian L. Denote the eigenvalues ofL by X\{L), ■ ■ ■ , Xn{L) 
satisfying Xi{L) < ••• < A„(L). Then Ai(L) = and 
1 = [1, 1, • • • , 1]"^ S i?" is its eigenvector. Moreover, if 
g is connected, A2 > 0. 

In this paper, all the considered agents move in a plane: 

Xi = Ui&R^, z = l,...,n, (4) 

where Ui is the control input. The leader of this consid- 
ered multi-agent system is active; that is, its state vari- 
ables keep changing. Its underlying dynamics can be ex- 
pressed as follows: 

' XO = Wo 

vq = a{t) = ao{t) + 5{t) xq, vq, 5 & (5) 
.y = xo 

where y{t) = Xo{t) is the measured output and a{t) is the 
(acceleration) input. Note that (5) is completely different 

from the agent dynamics (4) . In other words, the agents 
will track a leader with a different dynamics. 

In our problem formulation, the input a{t) may not be 
completely known. We assume that ao{t) is known and 
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S{t) is unknown but bounded with a given upper boimd 5 
(that is, I 1 1 < 6). The input a(t) is known if and only 
if S = 0. On the other hand, y = Xq is the only variable 
that can be obtained directly by the agents when they 
are connected to the leader. Our aim here is to propose 
a decentralized control scheme for each agent to follow 
the leader (i.e., Xi — » a;o). 

Since wo(i) cannot be measured even when the agents are 
connected to the leader, its value cannot be used in the 
control design. Instead, we have to estimate vq during 
the evolution. Note that, each agent has to estimate vq 
only by the information obtained from its neighbors in 
a decentralized way. The estimate of vo{t) by agent i is 
denoted by Vi{t) {i = 1, n). Therefore, for each agent, 
the local control scheme consists of two parts: 

• a neighbor-based feedback law; 

Ui=-k[ ^ aij{t){xi-Xj) + hi{t){xi-xo)] 

jeNi(t) (6) 
+ Vi, k > 0, i = 1, - ■ ■ ,n, 

where iVj is the set consisting of agent z's neighbor 
agents; 

• a dynamic neighbor-based system to estimate vo 

Vi =ao -jkl ^ aij{t){xi - Xj) + bi{t)- 

jemit) (7) 
{xi -xo)], i = !,■■■ ,n, 

for some positive constant 7 < 1. In fact, (7), can be 
viewed as an "observer" in some sense. 

Note that Ui in (6) is a local controller of agent i, which 
only depends on the information from its neighbors, and, 
in fact, when vq = 0, a = 0, the proposed control law 
(6) is consistent with the one given in Olfati-Saber and 
Murray (2004) . In addition, with the neighbor-based es- 
timation rule in a form of observer (7) to estimate the 
leader's velocity, each agent relies only on the locally 
available information at every moment. In other words, 
each agent cannot "observe" or "estimate" the leader di- 
rectly based on the measured information of the leader 
if it is not connected to the leader. In fact, it has to col- 
lect the information of the leader in a distributed way 
from its neighbor agents. 
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closed-loop system can be expressed as: 

X = u = —k{La- + B„) (g) I2X + kB„l iSi xo+v 
u = 1 O ao - 'yk{L„ + B„) O 72a; + ^k{B„l) ® xa 

where 7; e R (for any positive integer I) is the iden- 
tity matrix and ® denotes the Kronecker product, a : 
[0, cx)) V = {1,2, ••• , N} is a piecewise constant 
switching signal with successive switching times, Bcr is 
an n X n diagonal matrix whose ith diagonal element is 
bi{t) at time t, L^r is the Laplacian for the n agents. Note 
that, even in the case when the interconnection graph is 
connected, bi{t) may be always for some i, and there- 
fore, B„ may not be of full rank. 

Denote x = x — 1 ® xq and v = v — 1 ® vq. Because 
-k{L„ + B„) ® I2X + kB„l ®xq^ -k{L„ + B„) ® hx 
(invoking Lemma 2), we can obtain an error dynamics 
of (8) as follows: 



e = F^e + g, g = 



^ 
-l(g)(5> 



(9) 



where 



e = 



-k{L„ + B„) In 
-ykiL^ + B^) 



3 Main Results 

In this section, we investigate the consensus problem of 
multi- agent system (8), or the convergence analysis of 
system (9). If the information of the input a{t) can be 
used in local control design, we can prove that all the 
agents can follow the leader, though the leader keeps 
changing. If not, we can also get some estimation of the 
tracking error. We first assume that the interconnection 
graph Q is always connected, though the interconnec- 
tion topology keeps changing; and then we consider an 
extended case. 

As mentioned above, Q is connected if at least one agent 
in each of its component is connected with the leader. 
To be specific, if there are m > 1 components, then the 
Laplacian Lp (for any p Cz V) of the graph associated 
with n agents have m zero eigenvalues. For simplicity, 
we can rearrange the indices of n agents such that Lp 
can be rewritten as a block diagonal matrix: 



Lp — 



Regarding the switching interconnection graphs, the 



r2 



\ 
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where each block matrix is also a Laplacian of the cor- 
responding component. For convenience, denote Mp = 
Lp+Bp, where Lp is the weighted Laplacian and Bp {p e 
V) is the diagonal matrix as defined in Section 2. The 
next lemma is given for Mp. 

Lemma 3 // graph Qp is connected, then the symmetric 
matrix Mp associated with Gp is positive definite. 



If the switching interconnection graph keeps connected, 
then 

\im\\e{t)\\<C, (12) 

t—*oo 

for some constant C depending on 5. Moreover, ifa{t) is 
known (i.e., a{t) = ao{t) or S = 0), 



lim €{t) = 0. 

t^OO 



(13) 



Proof: We only need to prove the case when m = 1 . Let 
Ai, • • • , A„ be the eigenvalues of Laplacian Lp in the in- 
creasing order. From Lemma 2, Ai = and Aj > 0, i > 2. 
Denote n eigenvectors of by ^i, i = l....,n, with 
^1 = 1, an eigenvector of Lp corresponding to Ai = 0. 
Then any nonzero vector z G i?" can be expressed by 
z = Yl7=i ^'^^ some constants Ci,i = 1,2, ■ ■ ■ ,n. 
Moreover, Bp ^ since there is at least one agent con- 
nected to the leader. Without loss of generality, we as- 
sume bj > for some j, and it is obvious (-[Bpd > bj. 
Therefore, in either the case when C2 — ■■■ = €„ — 
(so ci ^ 0) or the case when Cj ^ for some i > 2, we 
always have 



MpZ 



z^LpZ + z^BpZ > XiCiClCi + z^BpZ > 



Proof: Take a Lyapunov function y(e) = e^(t)Pe(t) with 
symmetric positive definite matrix 



P = 



In -lln 



(14) 



The interconnection graph is time-varying, but the in- 
terconnection graph associated with Fp for some p €V 
is connected on an interval \ti,ti+i) with its topology 
unchanged. Consider the derivative of V{e): 



F(e)|(9) = e^(FjP + PFp)e + 2e'^Fj,g 
< -e^Qpe + 2(l + 7)5||e|| 



(15) 



for z ^0, which implies the conclusion. 



where 



Based on Lemma 3 and the fact that the set V is finite, ~ i^p^ + ^^p) 



'2fc(l-72)Mp 



= min{ eigenvalues of Mp € R" 
connected} > 0, 



(10) 



is fixed and depends directly on the constants and 
Pi for i = l,...,n, j = l,...,n given in (2) and (3). Its 
estimation is also related to the minimum nonzero eigen- 
value of Laplacian Lp, which has been widely studied in 
different situations (Merris, 1994). 



In some existing works, including Jadbabaie, Lin, & 
Morse (2003) and Lin, Broucke, & Francis (2004), the 
convergence analysis depends on theory of nonncgative 
matrices or stochastic matrices. However, Fp of system 

(9) fails to be transformed easily to a matrix with some 
properties related to stochastic matrices, and therefore, 
the effective methods used in Jadbabaie, Lin, & Morse 
(2003) or Lin, Broucke, & Francis (2004) may not work. 
Here, we propose a Lyapunov-based approach to deal 
with the problem. 

Theorem 4 For any fixed < 7 < 1 and A defined in 

(10) , we take a constant 



k > 



1 



47(1 - 72)A 



(11) 



1 

is a positive definite matrix because 27/— 2/5(1-7^) -^p 
and Mp are positive definite (by virtue of (11), Lemma 
1 and Lemma 3). 



Let /Xj, 



1, - • • ,n,j = 1,2 denote the (at most) 2n 



different eigenvalues of Qp though Qp G i?^"^^" defined 
in (16). Based on Ai(Mp), the eigenvalues of Mp, we have 
the 2n eigenvalues in the following forms: 

Mi.i = (l-7^)/^Ai(Mp)+7 

+ ^[(1 - ^^)kXi{Mp) + 7]2 - 47(1 - ^^)kXi{Mp) + 1, 

M^,2 = (l-7')fcA,(Mp)+7 

- \J[{^ - l^)kK{Mp) + 7]2 - 47(1 - 7^)A;A,(Mp) + 1, 

for i = l,...,n. Clearly, the smallest eigenvalue of Qp 
will be found in the form of /U,,2 for some i. 

Note that (11) implies kXi{Mp) > . In this case, 

/ii^2 increases as kXi{Mp) increases. Therefore, the min- 
imum eigenvalue of Qp will be no less than 



M = (l-7^)fcA + 7-'\/[(l-7^)A;A-7P + l >0, (17) 
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which is obtained by taking \i(Mp) = A with a given k 
satisfying (11). In addition, since the eigenvalues of P 
are either Umin = 1 - 7 or Umax = 1 + 7> we have 



(l-7)l|ef <ne)<(l + 7)lh 



(1^ 



Therefore, 



> 



2/3, 



where /3 = 2(A-y) ^ with p. defined in (17). 
Due to (18), 



Therefore, from (15), 



length of the intervals with the unconnected graphs as 
Tj in [Tj,Tj_|_i). In what follows, we denote an upper 

bound of T/ (j = 0, 1, • • • ) as T'^{< T), and a lower 

bound of T? (j = 0, 1, • • • ) as T%= T-T'^). 



Theorem 5 During each time interval [Tj, Tj^i), if the 
total period that the interconnection graph is connected 
(i.e., T'^) is sufficient large, then (12) still holds with k 
given in (11). Moreover, (13) holds if S = (or equiva- 
lently a{t) = ao{t) ). 

Proof: Still take a Lyapunov function V^(e) = e^Pe with 
P defined in (14), and then wc have (15). If the graph 
associated with Fp for some p ^ V is connected during 
[ti,ti+i), then, according to Theorem 4, we have 



V{e{ti+i)) < e 



-!3(U 



-t.) 



V{e{ti)) + 



(1+7)^ - 
(1-7)/?^' 



F(e)|(9)<-2/3F(e) + 2 



'(l + 7me)- 



1-7 

(1+7)'^' 
(l-7)/3 



or equivalently. 



V{e{t)) < l/(e(tO)e-'^(*-*') + ^^-^(1 - e'/^^*-*-)). 



(l-7)/3^ 



Thus, with to = 0, 



Vieit)) < y(e(0))e-'^* + ^^^(1 - (19) 

which implies (12) with taking C = jj^^S. 

Furthermore, if 5 = 0, then (13) is obtained. I 

Next, we consider an extended case: the interconnection 

graph is not always connected. Let T > be a (siifficient 
large) constant, and then we have a sequence of interval 
[Tj,Tj+i), j = 0, 1, • • • with To = to,Tj+i = Tj + T. 
Each interval [Tj, Tj_|_i) consists of a number of intervals 
(still expressed in the form of [ti,ii+i), during which 
the interconnection graph is time-invariant), including 
the intervals during which the graphs are connected and 
those during which the graphs are not. Wc assume that 
there is a constant r > 0, often called dwell time, with 
ii+i -ti>T, Vi. 

Denote the total length of the intervals associated with 
the connected graphs as Tj in [Tj,Tj+i) and the total 



If the graph associated with Fq for some q G V is not 
connected during [i;,i;+i). The minimum eigenvalue of 
is 7 — -\/l + 7^(< 0) and, by (18), we have 



where a = — ^^-^ • 

1-7 

Similarly, with (18), 
V{emi9) < aV{e{t)) + ^^^^^P, t G [t,,i,+i). 



a(l - 7) 



and therefore. 



V{e{tt+,)) < e«(*'+-*')F(e(i,))+^tof (e«^^-l)^-2. 

(20) 

Denote v = max{ii±2)l, |^(e"^' - 1)}. It is not 

hard to see that there are at most rud = [^] + 1 inter- 
vals (in [Tj , Tj+i)) associated with unconnected graphs. 
Therefore, we have 



F(e(T,+i)) <e-''^/+«^/y(e(T,)) + (1 + e^' + e'^' 



(21) 



With T] = gT<^_;^ V > 0. 
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If /3Te > a{T - T«) or Te > then u 

e-0T''+a{T-Tn < 1. Thus, 



K = 3, we can choose 



< !/J'+V(e(To)) + ^YT^^^'- 
For any t > 0, there is j such that Tj < t < Tj+i with 

Thus, (12) is obtained with taking C = ^J^^^^^S. 

Furthermore, if ^ = 0, then C = 0, which imphes (13), 
or e — > as t — > oo. I 

In fact, the proposed estimation idea can be extended to 
the case of an active leader with the following dynamics: 



(22) 



Xq 


_ ™2 
— Xq 


Xq 


— Xq 



x^ = a{f) = aa{f) + 5{t) 
y = Xo = xl& 



where y{t) is the measured output variable of the leader 
and a{t) is its input variable. The dynamics of each agent 
is still taken in the form of (4). Then we will construct 
an observer as we did for system (5). Here, for the space 
limitations, we only give the corresponding error system, 
which can be expressed as: 



/ -fcMp 7„ 

-7lfcMp In 



\ 



■7K_2feMp 
V-7«_ifeMp 



I„ 



0/ 



2 



/ \ 


\-l<S)Sj 



or equivalently in a compact form: 

where A; > and < 7^ < 1, (j = 1, k — 1) arc suit- 
able real munbcrs and ~ x^ — l®xl^ e i?^" witha;-'^ = x 
and x^ (2 < 2 < k) as the vector whose components are 
the respective estimated values of Xq by n agents. 

To obtain the results similar to Theorems 4 or 5, we need 
to find a suitable quadratic Lyapunov function; that is, 

to construct an appropriate positive definite matrix P 
such that Fp P + PFp is negative definite then the cor- 
responding graph Qp is connected. For example, when 



-kMp 



In 

In 





0/2, P ■■ 



T -±T 
In 3J 

-\ln 





It 



4 Conclusions 

This paper studied the consensus problem of a group 
of autonomous agents with an active leader, whose ve- 
locity cannot be measured. To solve the problem, a dis- 
tributed feedback (i.e., (6)) along with a distributed 
state-estimation rule (i.e., (7)) was proposed for each 
continuous-time dynamical agent in a varying intercon- 
nection topology. In fact, generalized cases, including 
those when the interconnection graphs are directed and 
when the dynamics of each agent is more complex than 
system (4), will be considered in future. 
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